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In Pure Inductive Logic, the principle of Strong Predicate Exchangeability 
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1 Introduction 


A recurring theme in the study of Pure Inductive Logic is symmetry. Amongst such ra¬ 
tional principles based on symmetry are the well-known principles of Atom and Predicate 
ExchangeabilitjU, respectively. 

The rational principle of Strong Predicate Exchangeability arose from a generalized 
version of the vP functions (see [6l Chapter 29]) that are the building block^of functions 
satisfying the principles of Atom Exchangeability and Unary Language Invariance. In 


^In the case of Predicate Exchangeability, we would like to point out that while the principle, in various 
formulations, was accepted as a basic condition for probability functions by both Rudolf Carnap 
and W.E. Johnson, the principle only recently was studied in more detail, providing representation 
theorems. 

^By ‘building blocks’ we mean that any function satisfying some rational principle can be represented 
as a convex combination of the building block functions. 
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fact, these generalized functions turned out to be just too strong to use as building 
blocks for Unary Language Invariance. 

With this in mind, and especially with the rather artihcial motivating example above, 
one might think that Strong Predicate Exchangeability is a rather artihcial principle and 
thus might only be of interest as a technical exercise. There is however an alternative 
way of obtaining Strong Predicate Exchangeability via a weak form of Johnson’s Suf- 
hcientness Postulate (JSP): just as JSP gives rise to Carnap’s Continuum of Inductive 
Methods whose members satisfy Atom Exchangeability, so can we obtain a collection of 
functions arising from a weaker form of JSP that are characterized by Strong Predicate 
Exchangeability (see |1] [Chapter 3.3]). We would then argue that while there may be no 
compelling argument for a rational agent to adopt Strong Predicate Exchangeability as 
a principle in its own right, it would be a consequence for any agent picking this weaker 
form of JSP. 

The aim of this paper is to present de Finetti - style representation theorems for prob¬ 
ability functions satisfying Strong Predicate Exchangeability in conjunction with Unary 
Language Invariance. We will show that any probabiliy function satisfying Strong Pre¬ 
dicate Exchangeability and Unary Language Invariance can be represented as a convex 
combination of functions that in addition also satisfy Weak Irrelevance. 


2 Notation and Principles 


The context of this paper is unary Pure Inductive Logic. We will be concerned with 
hrst order languages that only contain hnitely many predicate symbols Pi and count¬ 
ably many constant symbols Oi, 02 ,..., On, • • • which we can think of as exhausting the 
universe. For k G N’*' = {n G N | n > 0}, let Lk be the language containing only the 
predicates Pi, P 2 ,..., Pk- Unless otherwise stated we will take our default language L 
to be the language Lg. Let QFSL denote the set of quantiher-free sentences of L and SL 
the set of sentences of L. 

Let L = Lq. An atom of L is a formula 


<? 

«(^) = A 

i=l 

where +Pj(x), —Pi{x) stand for Pi{x), -^Pi{x), respectively. Note that for L = Lq, 
there are 2'^ atoms, denoted ai, a 2 , ■ ■ ■, cx 2 <i■, which we will assume to be in the usual 
lexicographic orderingJl 


■^In the usual lexicographic ordering, a\ = Ai=i <^2 = Ai=i P{x) A -^Pq{x), ai = Ai=i Pi^) A 

-^Pq-i{x) A Pq{x), etc., up to a2i = ALi ~^Pi^)- 
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A state description of L for ai,..., is a sentence 


* * * : ^n) •> 

i=l 

where ct/i. is an L-atom for each h,, i.e. hi G { 1 ,..., 2 '^} for each 1 < i < n. 

The following definition will turn out to be very useful in keeping track of the number 
of negations occurring in an atom. 

Definition 1: 

Let L = Lg. Dehne the function 7 ^ on the atoms of L by 

7 g(«) = k ^ a contains k negated predicates. 

We shall drop the index q whenever it is understood from the context. 

Definition 2: 

Let L = Lg and let w : SL ^ [0,1]. Then tc is a probability function if w satishes the 
following properties. 

(i) i«(T) = 1, 

(ii) if ip 1 = -I'd, then w{ip\/ -h) = w{ip) • w('d), 

(hi) w {3xp!{x)) = lim„^oo (Vr=i 

Recall that by Gaifman’s Theorem (see [3]) any probability function w : QFSL —)■ [0,1] 
satisfying (i) and (ii) above can uniquely be extended to a function w on SL satisfying 
(i)-(iii). By the Disjunct Normal Form Theorem it will be enough to define a function 
w on state descriptions of L. 

In the following dehnitions for rational principles we will assume that L = Lg and w is 
a probability function on SL. 

Constant Exchangeability (Ex) 

w satisfies Constant Exchangeability if for all L-sentences ip and all permutations a of 

M+, 

w{ip{ai ,..., a„)) = w{ip{a^(^i),a^(n)))- 

We will assume that all probability functions satisfy Constant Exchangeability. 

Predicate Exchangeability (Px) 

w satishes Px if for all L-sentences (p and all permutations a of the (indices of) predicates 
of L, 

w(yip(^P\i . . . , Pmi • • • ) ®n)) ■ ■ ■ i P(T{m)i • • • ) ®n))- 
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Atom Exchangeability (Ax) 

w satisfies Atom Exchangeability if for all permutations a of the (indices of) atoms of 

L, 



Weak Irrelevance Principle (WIP) 

w satisfies Weak Irrelevance if whenever '&,(p E QFSL have no constants or predicates 
in common then 

w{{} Aip) = tc('d) ■ w{(p). 

Unary Language Invariance (ULi) 

Let w he a probability function on L. Then w satisfies Unary Language Invariance if 
there is a family of probability functions one for each finite unary language C and 
satisfying Px + Ex such that = w and whenever C C then f SC = w‘~. 

We say that w satisfies ULi with V for a rational principle V, if each in the ULi 
family also satisfy V. 

We will now proceed to define the P-spectrum and in turn the principle of Spectrum 
Exchangeability, which is the main focus of this paper. 

Definition 3 (P-spectrum): 

Let L = Lq and 0(ai,..., a„) = AILi be a state description of L. We can view 

0 as 

9 Si 

0(^1, . . . , (Xn) ^hijipij) 1 

i=0 j=l 

where each for j G s*} is an atom of L with Aqi^ij) = i, n = J2i=o 

bij = ttk for that k with 0(ai,..., a„) |= ahij{ak). For each i G {0,..., g} let Ei be the 
equivalence relation on { 1 , ..., Sj} given by 

3E^k ^ hij hik‘ 

For i G {0,..., g} let Mi be the multiset of sizes of equivalence classes of Ei. The 
P-spectrum of 0 is the vector 


Definition 4 (Strong Predicate Exchangeability, SPx): 

Let L = Lq and w a probability function on L. w satisfies Strong Predicate Exchange¬ 
ability if and only if w{Q) = tc(<h) whenever 0 and <h have the same P-spectrum. 


SPx is a strong version of Px in the sense that it implies Px, but Px does not imply 
SPx. 
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Proposition 5. Let w be a probability function on L = Lq satisfying SPx. Then w 
satisfies Px. 

Proof: Let cr be a permutation of predicates, 0 a state description of L and a© the 
result of permuting all predicates occuring in 0 according to a. It is enough to show 
that 0 and u© have the same P-spectrum. 

Suppose 0 = ALoAJL and for some j,/c G n}, we have that hij = 

hik, so jEik for some i. Since ahij = implies = crahi^, a preserves the P*- 

equivalence of j and k. A similar argument gives that if j,/c G s*} are not 

Pj-equivalent, then A must hold. Thus we must have that the P-spectrum 

of 0 is the same as the P-spectrum of a©. By SPx for tc, w{Q) = w{aQ). -| 


The following counter-example will show that Px does not imply SPx. 

Example 6 (Px does not imply SPx). Suppose 0(ai,..., 05 ), <h(ai,..., 05 ) 
are state descriptions of L 3 given by 

0 = (Pi A P2 A -iPa) A {-'Pi A P2 A P3) A {-'Pi A -'P2 A P3) 

A (“IPi A -1P2 A P3) A (Pi A -1P2 A “'P3), 

<h = (Pi A -1P2 A P3) A (“iPi A P2 A P3) A (“iPi A P2 A “'P3) 

A (“IPi A P2 A “'P3) A (“IPi A -1P2 A P3). 


With the eight atoms of L 3 enumerated in lexicographic order, we obtain 


0 — 020^4050^, 

$ = Q;3Q;5Q;gQ;7. 

Note that there are six permutations of the atoms of L 3 that are induced by Px, and 
that 02 , 0 : 3 , 0:5 each have one negated predicate, while 0 : 4 , Og, 07 each have two negated 
predicates. Suppose 6 G Dg and let S denote the set of all permutations of predicates. 
Then one can verify easily that w given by 

satishes Px. Notice that $ and 0 have the same P-spectrum. We obtain 

w{Q) = - (& 2 & 4 & 5 &? + bsb^b^bl + b^hob-ib^ + b^b^bshl + bi^hb^bl + 63 & 7 & 2 & 6 ) > 

w{^) = - [bsb^bjbl + & 2 ^ 5 ^ 6^7 + ^ 5 ^ 3 ^ 7^4 + ^ 2 & 3 ^ 4^7 + ^ 3 ^ 2 ^ 6^4 + ^ 5 ^ 2 ^ 6 ^ 4 ) • 

Now letting 


b = 


19’ 19’ 19’ 19’ 19’ 19’ 19’ 19/ ’ 
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we clearly have 6 G ©s and we obtain 


1094 


m;(0) 

w{^) 


6 - 195 ’ 

1224 


6 - 195 ’ 


which clearly gives w{Q) ^ tc(<h) and thns w cannot satisfy SPx. 


Similarly we can observe that any fnnction satisfying Ax mnst also satisfy SPx, as we 
can easily see that any permntation a of atoms snch that 7g(a) = 7 g(cra) preserves P- 
spectra. Conversely whenever 0 and $ are state descriptions with the same P-spectrnm 
then there is a bijection between the atoms of 0 and those of 4> that can be extended to 
a permntation of atoms. It is easy to see that there are fnnctions satisfying SPx, bnt not 
Ax as any permntation that permntes atoms with different nnmbers of negations can be 
nsed to constrnct a connter-example in jnst the same fashion as the above example. 


3 A representation theorem for ULi with SPx 


The first step towards the desired representation theorem is defining the class of fnnctions 
that we will show to be the basic bnilding blocks for fnnctions satisfying ULi with 
SPx. It is apparent from the dehnition that these fnnctions are generalizations of the 
ip fnnctions that form the bnilding blocks for Ax + ULi, see e.g. [6]. As was discnssed 
in [1] the classes of and iP share a nnmber of properties, of which we will qnote 
(withont proof) the most relevant for onr pnrposes. 

Let p, r be conntable seqnences p = (po,Pi,P 2 , - - -), L = (t'o, '7 ‘2,...) and let B be the 

set 


B 


i>0 


Tj G [0,1] for j > 1 and tq a normalized cx-additive measnre on [0,1] 

Definition 7: 

Let L = Lq and let (p, r) G B and let 0(a) = 0(ai,..., a^) be a state description of L 
with 



m 

0(cii, • • • 5 ^m) 

i=l 
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Define the functions as follows: Let c be a sequence in N. Then 


jr( 0 A( 0 ,-- 

• ) Cm-l)) • Pcm ■ ^hm,Cm 

if Cm = 0 or Cl 7 ^ Cm for all / < m 


■ , Cm-l}) ■ Pcm 

if C; = Cm 7 ^ 0 for some 



/ < n and hi = hm, 

0 


otherwise. 


with 0 =0 (oi,..., Om-i) the unique state description such that 

0(ai,.. ) \= 0 (ai,.. • ; l) 


and 


^ rif c™ > 0 , 
y /jg dTQ^x) if Cm = 0. 

Dehne on state descriptions of L by 

^r(0(a)) = 


( 1 ) 


Note that this dehnition is slightly different than the original dehnition given in [3]: 
in the original dehnition we allowed even the r* for z > 0 to be normalized cx-additive 
measures instead of single point measures. 

The following theorem lists some properties of the functions. The proof is rather 
lengthy and technical, and in the case of Weak Irrelevance even requires a detour via a 
different dehnition for the v^’’^. As we believe the techniques required for the proof do 
not provide any beneht for the task at hand, and for the sake of brevity, we would like 
to refer the reader to Chapter 3 of [1], where detailed proofs for the claims are given. 

Theorem 8. Let {p,t) G B. Then v^’’^ is a probability funetion satisfying the prineiples 
Ex, SPx, ULi and WIP. H 

We can now state the representation theorem for functions satisfying ULi with SPx. In 
the proof we will be using methods from non-standard analysis, and in particular Loeb 
measure theory, to obtain the desired results. See e.g. [2] for details. 

Theorem 9. Let w be a probability function on Lg. Then w satisfies ULi with SPx if 
and only if there exists a normalised a-additive measure p on B such that 

w= f dp{{p,T)). (2) 

Jb 
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Proof: By Theorem El it is straightforward to show that any function of the form ([2]) 
satihes ULi with SPx. 

For the reverse, let w be a probablity function on Lq satisfying ULi with SPx. Working 
in a non-standard universe, let z/ G \ N. Then by ULi there exists an extension w^'' 
of w to L^. 

We can write w^’' as 

w^"(0(ai,... ,a„)) = ^ w^"(<F(ai,... ,0^.)). (3) 

<I>(ai,...,ai^)GSDLiy 

$ 1=0 


Since w^’' satisfies SPx, we can rephrase ([3]): fix some P-spectrum z> of a state description 
T(ai,..., Oi,) of L^. Then for each state description <F(ai,..., Oy) such that PSpec($) = 
PSpec(T) = z> we have 

Letting T = {<F(ai,..., Oy) | PSpec(<F) = PSpec(T)} for a fixed state description T, and 
partitioning the set of all state descriptions of for constants ai,..., hy a choice of 
T we obtain 

^^"( 0 ( 01 ,... ,a„)) = EE 

T $gT 
$ 1=0 

= 5^ |{4 e T14 h e}l ■ (ffli,..., oj) 

T ' ' 

where V T is the disjunction over all state descriptions in T. 

We will show that ^ probability function of the form v^’'^ for some (p, r) G 

B. 

First note that if <F G T then there exists a permutation a of the atoms of Li, preserving 
P-spectra and a permutation p of the constants oi,..., such that <h(ai,..., a^) = 
(jT(ap(i),..., We can then view probability of obtaining some 

<F(ai,..., tti) 1= 0(ai,..., an) with $ G T by randomly picking permutations a and p 
such that <F(ai,..., a^) = crT(ap(i),..., ap(^^)). 


Fix some T G SDLj, with PSpec(T) = z/ = (sq, Si,i, ..., Si^i, S 2 ,i,..., 52,^2) ■ ■ ■ where 






the Sij are the sizes of the equivalence classes in the P-spectrum of T0 Then the 
probability of picking a constant of a particular equivalence class at random is —, 
where Sjj is the size of this equivalence class according to PSpec(T). Let Pi > P 2 > 
Ps > ■ ■ ■ > Pv be the list of these probabilities, in decreasing order, and let s'^,..., 
be an enumeration of the equivalence classes such that Pi = Here, N is the number 
of equivalence classes in D. Note that N may very well be infinite. Then the probability 
of randomly picking (with replacement) constants ai,...,a„ from equivalence classes 
■ ■ ■ > for 1 < Cl,..., c„ < N, is ULiPcM 

We now need to take care of the specific atom picked for each of the classes , s'^. 

Again, as we are going to take standard parts and thus the difference between picking 
atoms with and without replacement will disappear, we can treat picking an atom to 
represent each class as independent of each other. Note that the only restriction for 
picking an atom is that if the original atom in T representing this class has j negated 
predicates occurring, so must the atom we pick at random have j predicates in order 
to preserve the P-spectrum of T. The atom we pick does not even have to occur in T. 
We can view randomly picking an atom in this way just as picking predicates without 
replacement from the original atom, determining the atom we want to replace it with in 
this way. 

Consider the equivalence class for some m < n. Suppose that the atom of 
this equivalence class represents has j negated predicates occurring. Suppose that 
0(ai,...,a„) 1= with = r. Then the probability that picking an 

atom (3 of with = j and /3{x) \= ah^{x) is determined as follows: picking 

predicates randomly from f3 without replacement and if the predicate Pi for 1 < i < q 
occurs positively in we obtain a factor ^ 3 ^^, where ki is the number of predicates 
Pt, 1 < t < i that occur positively in Similarly if Pj occurs negatively we obtain 
a factor with ki the number of predicates occurring negatively in Once we 

have picked q predicates this way, we are left with an arbitrary choice of predicates to 
pick, resulting in a factor of 1 for the choice of Pt, t > q. By commutativity, we obtain 
the probability as 


r —1 . . q—r—1 

n 

ly — I V — i — 

2=0 2=0 

As we will be taking standard parts and i only takes finite values, we may write 0 as 


"‘Note that sq and only have a single index, as there can be only one equivalence class of constants 
instantiating an atom with no negations or only negations occurring, respectively. 

^Just as in the proof of the representation theorem for ULi (see 0) it will suffice to consider picking 
constants with replacement, as the difference to picking constants without replacement will disappear 
once we take standard parts. 
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for some r G *[0,1], as the difference between (jl]) and ([5]) will disappear once we have 
taken standard parts. 

Thns for the probability that a hxed <h G T is snch that |= obtain 

a factor of nr=iPci, where s'^. is the eqnivalence class of a* in the P-spectrum of <h. 

Fnrthermore we obtain a factor of for each k G {ci,..., c„}. The 

reason we only have one occnrrence of this factor is that once we have picked an atom for 
one constant instantiating a particnlar eqnivalence class of the P-spectrnm, each further 
constant from the same class must instantiate the same atom. For the same reason, the 
probability must be 0 if we have Cj = Cj for some 1 < < n but a/j. and ah. are 

two different atoms. In contrast to the Px case we can treat the picking of predicates 
described above as independent for each equivalence class of atoms: we are in fact just 
picking atoms of Ly with the correct number of negations occurring while ensuring their 
restriction to Lq yields the desired atom. As the probability of picking the same atom of 
Ly for any two equivalence classes is infinitesimal, we can waive the difference between 
picking these atoms with and without replacement, resulting in the probability of each 
atom being picked independent of the choice of equivalence classes. Thus we obtain 

n 

Hpo.- n 

*=1 fcG{ci,...,Cn} 

as the probability, in case that whenever Cj = Cj then hi = hj. But this is just a 
non-standard version of • • • > c„)) for p = { 0 ,pi,p 2 ,...) and r = 

(tq, Ti, r 2 ,...,) for an arbitrary measure Tq. 

We now obtain 

11$ G T I d) h Oil 

Ci>l 

for a hxed 0 such that PSpec(0) = h and the * indicating the non-standard versions of 
the functions dehned in Dehnition [71 

Dehne a measure p on the P-spectra of state descriptions of Ly by /i({h}) = w^’' (V 
and we obtain 


dpiP). 




|{$GT^$h0}| 

|T| 


Vt 


|{$ G T|$ h 0}l 

W\ 


dp{P) 
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Now taking standard parts we obtain 


w^'^(0(ai,... ,a„)) 


as (p, r) represents z/. 


'‘n^’^(0(ai,... ,a„)) d/i(z>) 

*n^’’^(0(ai,... ,a„)) d/i((p,r)) ) , 


(p.d 


(6) 


We can now use Loeb measures to move the operation of taking standard parts inside the 
integral and claim that °(*n^’’'( 0 (ai,..., a„))) = , a„)) for some standard 

versions p' of p and r' for r. 

It remains to hnd (p', r') G B such that 

°(*#“(0(ai,..., a„))) = n^’^(0(ai,..., a„)) (7) 


First notice that *j^’’’(0(ai,..., a„), c) is a hnite product for each c and so we can move 
the standard part operation all the way to the individual factors. This provides us with 
an obvious candidate for r': take r' = °rj for each i G N, z > 1 . 

For the pi there are three cases to consider. If there are only hnitely many equivalence 
classes in z>, there exists some n G M such that p* = 0 for each i > n. In this case we 
have °Pi — 1 ~ Pi ~ °Pi 1 < z < n and let 

p' = 0 otherwise. Then clearly we have 

°(*/’^( 0 (ai,..., a„), c)) = /’^( 0 (ai,..., a^, ( 8 ) 


and (jTj) holds for (p', r') as there are only hnitely many instances of occurring. 

Otherwise we have that p* > 0 for each z G M. Suppose that in this case we have 
J2i£N°Pi ~ there is no weight carried by the p* with non-standard indices z G 

\ M. Then we can take p' = °pi for each z G N, z > 1 and po = 0 for ([8]) to hold: we 
can interpret z;^’'^( 0 (ai,..., a„), c) as an instance of integration by a discrete measure: 
Let p be the product measure giving weight nr=i Pci to the point c G and let / be 
the function dehned by 

/(e(oi,...,a„),c)= n 

ie{ci,...,c„} 

Then we can write 

*z;^’^(0(ai,... ,an),c) = ^ /’^(0(ai,..., a^), c) = / /(0(ai,..., a^), c) dp(c). (9) 

cG*N" 

Now taking the standard part of the integral in (|9]) and applying Loeb measure theory in 
this situation, we obtain as Loeb measure the measure on M” giving weight Y\a=i Pci 
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to the point c G N”, observing that whenever c G is snch that for some j < n, 
Cj G \ N, we have ° ( YYi=iPci) = 0 and thus ([7]) holds. 

Lastly suppose that XlieN °Pi < immediately have that while = 

1, simply taking standard parts of each pi as above will lead to v^'’'^'{T) < 1. The obvious 
problem now is to attribute the weight ‘lost’ by simply taking standard parts to the p' 
with standard indices. As po has not been used yet, we will put all this weight into pg 
and it remains to hnd a measure tq such that the equation ([7]) holds. 

In more detail, let p' = °pi for each i G N, i > 1 and let pg = 1 — XlieN °Pi- some c 
such that there exists j with °pc^ = 0 and Pc^ > 0. Let C{c,j) be the collection 

C{c,j) = {e\ Wi j ^ ei = d) A (i = j -)■ Pe^ > 0 A °Pe^ = 0)}, 

i.e. the sequences in C(c, j) only differ in the jth component, and each of the disappearing 
Pi occurs in one of the sequences. 

Then we obtain 


E np'. ■ n 1 = 

eeC(cj) *=1 feG{ei,...,e„} 


° / 


V 


Wpc. n 

* = 1 feG{ci,...,Cn}\{Cj} 


\ 

^ ft. 


Pj>0 

\ °Pj =0 




where hk here is that hg such that k = Cg {k = e*, respectively). 

Let Tg be a measure on *[0,1] such that tq gives weight pj/p'o to the point tj for each j 
such that pj > 0 and °pj = 0, and weight 0 to all other points. Then we obtain 


/ \ 



= Po f — xY (ir(f (x), (10) 

i[o,i] 

where is the corresponding Loeb measure to Tg. We can continue in this way until 
all such Pi have been collected into a factor of the form flTU]) . 

Letting Tg = Tjf a straightforward calculation shows that 

°*vP’^{e) = n^’^(0), (11) 
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as we can now rednce the left-hand side to the sitnation given in ([9]), with po = p^, tq 
as dehned above, and °pi = 1 : as the Pi > 0 with °pi = 0 are now collected into 
Po, jnst let these p* = 0. 

Going back to ([ 6 ]), we obtain together with flTT]) 

w^''(0(ai,... ,a„)) = ( [ *n^’’^(0(ai,... ,a„)) dp((p,r)) 

V J{p,T) 

= [ _ {e{ai,... ,an)) dp^{(p',T')), 

where is the Loeb measnre corresponding to p. -| 

Lemma 10. The v^’’^ are the only functions satisfying ULi with SPx + WIP. 


Proof: Let tc be a probability fnnction satisfying ULi with SPx -|- WIP and let G 
QFSL. Using ULI, extend w to some w' on a langnage L' large enongh so that we can 
permnte the predicates and constants of'd to obtain d' G QFSL' with no predicates or 
constants in common with d. As SPx implies Px, and by ULi we obtain w{'d) = w'{'d) = 
w'{'d'). Then we obtain 


0 


2{w'{'d A d') — w'('d) • 

[ [ v^f{t})dp{{r,p))- [ <f(d')d/i((p,r)) 

Jb Jb Jb 


+ f Ad')d/i((p,r)) 

Jb 



^ dp{{r, p)) dp{{p, r)) 

dp{{f,p))dp{{p,T)), 


by the Representation Theorem [HI As the fnnction nnder the integral is non-negative 
we mnst have a measnre 1 snbset of B snch that v^f is constant on this set for each 
'd G QFSL and therefore we mnst have w' = vfff for any (p, r) in this set. By ULi we 
obtain that w = w' \ SL = , as reqnired. -| 


4 The General Representation Theorem 


Jnst as for the probability fnnctions satisfying Predicate and Atom Exhcangeabilitjj^, 
respectively, we obtain a similar resnlt for Strong Predicate Exchangeability: 

®See e.g. for the result concerning Predicate Exchangeability and [3 Chapter 34] for the result 
concerning Atom Exchangeability. 
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Theorem 11. Let w be a probability function on L. Then w satisfies SPx if and only 
if there are A > 0 and probability functions Wi, W 2 satisfying ULi with SPx such that 

w = (1 + A)wi — Xw2. 


In the proof, we will use a slightly different formulatioiJll for the v^’'^ functions: Let 
be dehned by 

n 

( 12 ) 

e&Zl r=l 

where is the set of all functions e : {l,...,n} {1,..., 2*^} and eifp) G ©29 is given 

by 


e{p) = {ni,mp.n+ p„r(2,o)/2p,„+ Y. p*)’ 

e( 2 )=l e{i)=2 e[i)=2^ 

with Rp^n = 1 — Y^'i=iPi /'^(s, 0) = /jQ _a;)'?-79(«) drfix). It is easy to verify 

that if Pi = 0 for i > n, then = vff^. As usual, we will omit Lq whenever it is 
understood from the context. 


In the proof we will replicate the methods used for the analogous theorem for probability 
functions satisfying Predicate Exchangeability, see e.g. Lemma 13 and Theorem 14 in 

0 . 

Proof: Suppose that tc = (1 + A)tci — \w 2 for some A > 0 and wi,W 2 probability 
functions satisfying ULi with SPx. Then it is straightforward to check that w is a 
probability function satisfying SPx, but not necessarily ULi. 


So suppose that tc is a probability function satisfying SPx. Let x G ©29 and consider 
the function w^. We can close this function under SPx by letting 




1 

1 ^ 


E 

ctGS 


W, 


a(x) 5 


(13) 


where S is the set of all permutations of {1,..., 2'?} that preserve P-spectra. 

It is then easy to check that we obtain a de Finetti representation of w of the form 


w = 


Z£dju(x). 


(14) 


So suppose that p is a measure putting all weight on a singleton {T}, i.e. w = for 
some X G ©29. 

^In fact, the functions are instrumental to the proof of Theorem [51 
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Pick p such that po = 0, pi = Xi for i = 1,..., 2*? and p* = 0 for i > 2^. Then for 
arbitrary r, will have occurring in its representation flT^ . as clearly e G such 
that e{i) = i will result in = tCe(p) occurring, and for each permutation a such that 
Wo-(x) occurs in the function e' = e o cr G will ensure that tCo-(x) occurs in as 

well. 

Consider the factor Hrli accompanying We{p)- If a is a permuta¬ 

tion of {1,... ,2'^} that preserves P-spectra, then for e' = e o a we can easily check 
that 


29 29 

_ ^^y-yqieir)) _ JJ” .^7?(e'W) (■ ]^ _ ^ 

r=l r=l 

as the atoms ae(r), Cie'{r) have the same number of negations. 

So we have each Wa(s) occurring in z^ occurring in v^q^ with the same factor. Similarly, 
for each x G D 2 <j such that occurs in v^’q^, all the other occurring in z^ also occur 
in so we can write 




p.T 

^29 = 


E 

eeE 


^e,r * *Se 


• 2 ;, 


e{p), 


( 16 ) 


where is a normalizing factor, ae,r is the factor ~ 7-^)'?-79(eW) 

is the collection of representatives of equivalence classes of under the equivalence 
relation defined by 

^ '^e{p)) We'(p) occur in the same z^. 


Note that while depends on both p and r, the functions Zg^p) only depend on p while 
Oe,- only depends on r. 

Fixing an enumeration of E, fix some Tg for each e G P and let A be the E x E matrix 
with entry a(e,/) = o,f,Te- We then obtain the equation 





p.Te 

^'29 

= A- 

Se * ^e{p) 


V ; / 


V s / 


(17) 


We will show that the entries of A, i.e. the Tg, can be picked such that A is regular. 

Letting t = \E\, define the matrix for 1 < p < *2 < • • • < L' E ^ the j x j sub¬ 

matrix of A obtained by taking the ii,, Zj’th rows and columns of A. By induction on 
j, we will show that the Tg^it can be picked such that is regular. It will suffice 

to obtain for each row products of the form nr=i ^^t necessarily x + y = 1, nor 
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even x, y < 1 , as we can add a factor (x^ + VrY for each r G { 1 ,..., 2 '^} to the entry in 
A to obtain the reqnired form. 


For j = 1, this is trivial: jnst pick each to be neither 0 nor 1. So suppose j = k + 1 

_1-29 

for some k > 1. The polynomial Y\r=iXp'y^~^'" takes its maximum value on © 22 'j+i 
at Xr = Sr/2'^+^, Ur = q — T G {1,..., 2^}. Considering the previously fixed 

enumeration of E, there exists some e such that 


29 


29 




r=l 


r=l 


for any / 7 ^ e. For if not, then for some / 7 ^ e we have 


29 


29 


n(s.,e 2 -^-')*-((g - Sr,e)2-'^-y-^-^ < l[{Sr,e2-'^-Y^-f {{q - Sr,e)2-'^-^: 


9 ^r,f 


r=l 


r=l 

2 ^ 


< 




r=l 


and continuing in this way, we arrive at a contradiction. 


By the inductive hypothesis there are choices for the Xr,i^, yr,i,n for im G {ii,..., 

such that the sub-matrix is regular. Treating the Xr,yr as unknowns 

for the moment we obtain for the determinant of an expression of the form 


det(2l(i,,...,ip) = 


29 


29 




r=l 


f£{il,-,ij}\{ie} r=l 


( 18 ) 

for some choices of ±, where the Af are the corresponding sub-matrices of 
Picking Xr = (sr,e2“'^“^)^, yr = {{q — Sr,e)2~‘^~Y^ for large enough g > 0 the dominant 
term of ffTSjl becomes 

29 

r=l 


and as for this choice of x^, yr we clearly have nS! __^xY’‘'yr > 0 and by the inductive 

hypothesis 7 ^ 0, we get that det( 74 (i^,,,,,ip 7 ^ 0. Now introducing 

factors Y^J=i{xr + yrY as necessary, we obtain that A is a regular matrix with the entries 
having the required form. 


As A is (can be picked to be) regular, we obtain from flTT)) 




( '■ \ 
\ ■ 


( '■ \ 

' ^e{p) 

\ / 


(19) 
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and we can now obtain = Ze(p) as a difference of fnnctions we have 


— 


1 


■ ^ 6e • 

e£E 


and collecting the with positive coefficients in one term, we obtain 


Zs; = j-Wi-\-W2, ( 20 ) 

where Wi is a probability fnnction consisting of the v^q'" with positive coefficients and 
W 2 a probability fnnction consisting of the v^q'' with negative coefficients. 

Since = tai(T) = W 2 (T) = 1, we must have 7 — A = 1, and thus we obtain 

7 = 1 + A. As furthermore tci, W 2 are convex combinations of probability functions 
satisfying ULi with SPx, we have the desired representation for z^. Note that A depends 
only on 2 '^ and the entries of A~^, which in turn only depend on the Tg- As zg only 
determines p, we obtain a uniform A for all z^. 

Now returning to the general case of w of the form flT^ . we obtain 


w= zgdp,{x) 

J X 

= / (1 + X)wi^s; - Xw2,xdp{x) 

J X 

= (1 + A) / wi^gdp{x) — A / W2,sdp{x) 

J X J X 

= (1 + X)Wi - Xw2 


for some probability functions Wi,W 2 satisfying ULi with SPx, as they are convex com¬ 
binations of functions satisfying these principles. -| 


5 Conclusion 


In this paper we have introduced the principle of Strong Predicate Exchangeability, 
for which we have provided two de Finetti ~ style representation theorems. While the 
principle arose rather by chance, and is more indirectly justihed as a rational principle 
for rational agents, the representation theorems presented in this paper £t nicely into 
the story of Pure Inductive Logic so far. 

Comparing the representation theorems provided in this paper with similar results for 
Unary Language Invariance it appears there is a recurring theme: Looking at presently 
known results the building blocks for representing functions satisfying ULi all share the 
property of Weak Irrelevance. At the same time, there exist representation theorems for 
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general probability functions satsifying V showing these to be differences of functions 
that satisfy ULi with V. 

As these principles have so far been based on a symmetry based on the language in¬ 
volved, one might be inclined to expect the same behaviour for other principles based 
on symmetry, at least where it concerns purely unary languages. In terms of polyadic 
languages, there exists a similar result for Spectrum Exchangeability (generalizing Ax). 
As the building blocks for the principle SPx discussed in this paper are quite similar 
to the (unary) functions, whose polyadic versions play a role in the representation 
theorem for Spectrum Exchangeability, one might expect a similar result for a polyadic 
version of Px, SPx. 
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